Space-Time-Frequency Degrees of Freedom: 
Fundamental Limits for Spatial Information 



Leif W. Hanlent and Thushara D. Abhayapala^ 
National ICT Australia and Australian National University 
{Leif. Han len, Thushara . Abhayapala}@nicta . com . au 



o 
o 

(N 



O 



> 

in 
o 

o 
l> 
o 

O 



X 



Abstract — We bound the number of electromagnetic signals 
which may be observed over a frequency range [F — W, F + W] 
a time interval [0, T] within a sphere of radius R. We show 
that the such constrained signals may be represented by a 
series expansion whose terms are bounded exponentially to zero 
beyond a threshold. Our result implies there is a finite amount 
of information which may be extracted from a region of space 
via electromagnetic radiation. 

I. Introduction 

Wireless communication is fundamentally limited by the 
physics of the medium. Electromagnetic wave propagation has 
been given [1,2] as a motivation for developing such limits: 
information is ultimately carried on electromagnetic waves. 
Narrowband degrees of freedom (dimensionality) results have 
been given for dense multipath [3-5] and subsequently ex- 
tended to sparse systems. Here, the signal bandwidth is neg- 
ligible: dimensionality results are defined in wavelengths. 

Narrow-band wavefields were shown to have limited con- 
centrations [6]. The limit was based upon the free-space 
Helmholtz (wave) equation - a time independent variation of 
the electromagnetic wave [7]. Such waves may be represented 
by a functional series, whose terms are bounded exponentially 
toward zero beyond some limit. This limit was used to describe 
a random MIMO channel in dense [8] multipath and provide 
capacity results. 

More recent work - including wide-band MIMO motivates 
analysis of the capability of spatially diverse signals to support 
multiplexing over significant bandwidths. 

Given a region, bounded by radius R, centre- 
frequency F, bandwidth 2W and observation time 
T, what is the number T> of wireless ( electromag- 
netic) signals may be observed? 

In [9] an approximate dimensionality result was given. This 
bound suffered was excessively complex - resulting in a 
loose over-bound. In this work we provide exponential error 
bounds - reflecting the results of [3], and provide a tighter 
bound on the dimensionality of 3D-spatial broadband signals. 
In developing our result we will also show how the four 
parameters (R, T, W, F) may be traded against each other. 

The remainder of this paper is arranged as follows: We 
provide a truncation point and bound the error for electro- 
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magnetic signals in space in Section HI] This gives our main 
result in Theorem [T] Section UTU gives plots of the degrees of 
freedom, while Section [IV] provides a simple application of 
the dimensionality result to MIMO mutual information. We 
draw conclusions in Section [V] We formally define spatially 
constraining signals as a compact operator, and develop proofs 
in the Appendix. 

II. Dimensionality 

Existing dimensionality results for signals 3D space, with 
non-trivial bandwidth are limited by 



V WT = 2WT + 1 
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where ([D is from [10], formalised in [11] and (f2]i is from [12]. 
Fundamentally, we seek to develop a result which combines 
both (fl~|i and broadband, spatially diverse signals. 

Source-free (propagating) electric fields ^(r, t), are solu- 
tions of the free-space Maxwell wave equation [7]: 



c 2 dt 2 



#(r,t) = 



(3) 



where A = (d 2 /dx 2 7 d 2 /dy 2 ,d 2 /dz 2 ) and c=3x 10 8 ms _1 
is the speed of light. The vector r = (r, 6, <fi) with < 8 < ir, 
< qb < 2ir denotes position. We now formally pose: 

Problem 1: Given a function in space-time x(r,t) which 
is non-zero for ||r|| < R and t E [0, T] has a frequency 
component in [F — W, F + W] and satisfies (f3]); what number 
T> of signals ip(r,t) are required to parameterize x(r,t)? 

Before addressing Problem[T] observe that we may represent 
any signal which is constrained to [0, T] x [0, R] and satisfying 
(O by a solution of ([3]). In Cartesian coordinates such solutions 
are exponentials [13]: 



i]/ k (r, t) = exp (— t|k|ci - ik • r) 



(4) 



where k is the vector wave-number and i = The 
magnitude |k| = 2nf/c is the well-known scalar wave- 
number. 

Any function represented in terms of may be written 
as a series expansion (l24l i. The series itself is not important, 
simply that it exists. This series may be truncated at a point JV 
which is an increasing function of frequency, time and space: 



Lemma 1 (Truncation Point): The critical threshold (a 
function of |r|, t) at frequency f is 



Af(r,t;f)=Af T (t;f)+MB(r;f) 
tfrfcf) = \enA f t] 

■A/s(r; /) 
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Once we have chosen an appropriate threshold, increasing Af 
reduces the truncation error exponentially. 

Lemma 2 (Truncation Error): The truncation error is 



t M < 2/e ps 0.74 



(8) 



and for any a, S > 1 



„2-<5-c 



eu + s+ a < <lm ■ e" " " (9) 
We may use © and (|7]l and the tightness of the truncation 
to define the dimesionality of the 3D spatial signals. 

Theorem 1 (3D dimensionality T>j,d)'- The number of or- 
thogonal electromagnetic waves which may be observed in 
a three-dimensional spatial region bounded by radius R, over 
frequency range F ± W and time interval [0, T] is 



V 3D ps (en2WT + 1) 
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Note F > W by definition, so both terms in ( TTOb are always 
positive. The second term in ( TTOb gives an estimate of the effect 
of signal bandwidth on the degrees of freedom in space. For 
practical applications we expect ii«c and TW to be small 
{TW < 10). Thus, for the second term in ( TTOb to be non- 
negligible we require y/FW ps c, where we are interested 
only in magnitudes. 

A. Asymptotic Results 

For R — > ([Toll reduces to 7e7r7W/3 + 1 which over- 
bounds CO)- For T, W — > 0, ([Toll reduces to while for 
^ 0, T -> (dOli reduces to © with F -> F + For 
extreme broadband signals F = W, and 
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and when all parameters are non-trivial 
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We have considered two common spatially diverse scenar- 
ios. In FigureQIwe have used a centre frequency F = 2.4GHz, 
1kHz bandwidth and R < 2X. Figure l(a)| shows a mesh of 
the degrees of freedom, while Figure [T(b) gives a contour plot. 



The super-linear growth in DoF can be seen as both R and 
W increase. 
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(a) DoF vs bandwidth W and region radius R 
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(b) Contours 

Fig. 1. Number of degrees of freedom for moderate W and T = 0.5ms, 
F = 2AGHz, X = 0.125m: Curvature toward bottom of Fig. |l(b)| denotes 
saturation wrt. radius. 



Figure [2] shows the DoF for a broadband signal W < F 
with centre frequency F = 2.4MHz. In this case the centre 
wave-length is 125m (and at F + W, A m ; n = 62.5m) so R <C 
A/2. In this case at R — > we see the usual 2V^T linear 
growth in DoF, atRw A m ; n /4 we see a knee-point in the DoF 
surface, corresponding to spatial degrees of freedom becoming 
effective. This can be seen by the curvature of the contours 
near R — 5m in Figure |2(b)| 

IV. Example: Mutual Information 1 

We assume all channel eigenvalues are equal magnitude 
in space and frequency, up to Mr and TVs respectively. The 
transmitter uses (|4ji as matched filters for the channel and sends 
uniform power p on the subset of modes with non-neglible 
magnitude. This is a reasonable capacity approximation [14]. 

A naive application of ( TTOb to mutual information would be 
I = 2?log(l + pfD) < p. This ignores the random nature 
of the MIMO channel: spatial signals are mixed through a 
random scattering channel, while frequency signals are not. 
Assume both transmitter and receiver have identical geome- 
tries and are situated in dense scatter. 
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Fig. 2. Number of degrees of freedom for large W , small R and T = lfj,s, 
F = 2 AM Hz, A = 125m 



Consider Figure [3] every horizontal dashed line may be con- 
sidered as an input element with each element operating at 2W 
different frequency taps (eg. through OFDM). At frequency 
F-W<f<F + W there are N t = {enRf/c + l) 2 , 
independent input signals from (|2]). Then there are 
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parallel input channels and mutual information at / is T 



f 



Nt 

N t \og[ 1 + 



Where X is a Gaussian random matrix of dimension N t (f), 
see for example [6]. Since each frequency channel is indepen- 
dent, the total mutual information is found by combining (Tl3T > 
and 

N t (fY 



F+W 



^ N t (f) log I 1 + p- 

f=F-W V 
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which may be calculated numerically. Note, in the case of 
Nt(f) — const we return to the classic parallel channel result 



T = pN t . For N t (f) an increasing function of /, the sum (fl4b 
is increased, thus 



x > p {e*R(F-W) +1 



(15) 



Due to random scattering, spatial modes provide a linear 
increase in capacity, while frequency modes provide parallel 
channels. 

V. Conclusion 

We have shown that the degrees of freedom for a spherically 
restricted broadband wireless signal is proportional to the 
surface area of the spatial region, the square of the frequency 
and bandwidth and the DoF of the broadband signal itself. 
We have shown that the error associated with truncating such 
a signal at N terms decreases exponentially as TV increases. 

As an example we have shown that broadband spatial 
communication systems may have a capacity beyond that ex- 
pected by combining MIMO capacity results by with parallel 
frequency channels. 

Appendix I 
Operator Material 

Definition 1 (Truncation Projection D): Given the spatial 
interval S and time interval [0, T], the truncation operator 
D sets a field /(r, i) to zero outside the time- and space- 
intervals. 



Df(r,t) = 



f(r,t) r e § and t e [0,T] 







else 



(16) 



Definition 2 (Wavefield Projection W): The wavefield pro- 
jection W projects afield f(r, t) onto solutions ^(r, i) of (0. 



W7(r,t)= ]T fi, 



(17) 



f(r,t)^i >min (r,t)dtdr 



k is the wave vector in three dimensions k = (k x ,k y ,k z ) 
with scalar wave number k = |k| = (fc 2 , + fc 2 . + fc 2 ) 1//2 [13, 
eqn.6.94 p.759]. ^i im ,n is given by © with the values of k 
chosen discretely: 
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Using ( fT6] l and ( fTTI i we may write the signal observed in 

§ x T as: 

g{v,t)=WDf{v,t) (19) 

Lemma 3: WD is a compact operator. 
Lemma [3] emphasizes that although there are infinitely many 
independent electromagnetic waves, only a finite number of 
electromagnetic signals may be resolved within the region 
§ x T. The implication of this is that any approximation for 
a given signal has a bounded error. 



Appendix II 
Proofs 

Proof: [Lemma [TJ 
From 

*k(r, t) — exp(— ikminCt) exp (^—ikct — ik ■ rj (20) 

= exp(-t/c min ct)^ k (r, t) (21) 

where k r denotes the vector dot product and < k < AttW/ c. 
We wish to bound the number of terms required to approxi- 
mate this function. Note exp(— ik m i n ct) has exactly one degree 
of freedom, so we may equivalently calculate the DoF for fy. 
Using the Jacobi-Anger expansion [15, eqn2.45, pp.32] and 
summation theorem [15, eqn2.29, pp.27] 



= 47r£ t "j„(fc||r||) J2 C(?)^(k) (22) 



n=0 



where j n (z) — y/j^J n+ i(z) is a spherical Bessel function. 
From [13, 8.534.1] 2 



e- Lckt =J2i p (2p+l)j p (ckt) 

p=0 

Combining (l22l i and ( f23l 
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^ N \r,t) = ^^i p {2p+l)j p (ckt) 
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We may truncate \P(r, t) and bound the error as in [3]: 

e {PtN) = \*(r,t)-^ p > N \v,t) 
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Taking the abso lute val ues inside the summation and using 
EUnW)^ < (2n+ 1)/(2tt) [15, pp.27] gives 



ep.iv < 2 E ( 2 P + !) Jp(cfc*)| E( 2n+1 )l^( fc l r DI (25) 

p>JV n>N 

From [3, 12] 
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2 T(n + 3/2) 

Using the identity (2n + 1)/T(n + 3/2) = 1/T(n + 1/2 
and [16, pp.257] T(n + 1/2) > e""" 1 / 2 ^ + 1/2)™(2tt) 1 / 2 
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n = 1 



F + W 



Fig. 3. Geometry for spatial functions. _F — VF</<_F + 14 / and 
< | r- j < i?. Time forms a third dimension (into the page). 



Both sums 
A + 1 > ek\r\/2. 
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0<f<2W and F-W<f<F + W ■ 

Proof: [Lemma [2] Define a; = ec/ci and y = ekR then 
using (f30t 

e7V+a,P+,5 / P + l \ I A + 1 



P+l + <5 



A + l + 5 



.P + iy + 1 

Now a, <5 > 1, P + 1 > £ and A + 1 > y by definition 
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Using the identity (1 + a/N) N < e a ■ 

Proof: [Theorem [H From (f30b P may found directly by 
using the maximum values of t and fc: 



P = en2WT 



(31) 



Truncating (I30t at P gives Z>t = 2eirWT+l terms. The same 
technique cannot be used for A, since the bound becomes 
excessively loose. Instead we use a geometric argument: 

Consider Figure [3] The dotted vertical lines give the fre- 
quency constraints, while the top line n = eirRf/c gives 
the spatial constraint of (|7). The constraint set defines a 
trapezium in the space-frequency plane (or trapezoid when 
time is included). The heights of the trapezium are found from 
d7j with / = F±W. Note that the figure is not drawn to scale: 
for any reasonable value of R, the slope of the line enR/c is 
almost zero. 

Each horizontal dashed line represents a collection of time- 
frequency signals which may be observed at a point in space. 
Spatial diversity allows observation of multiple collections. 



Each collection has an intrinsic dimensionality of eir2AwT 
where Aw is the effective (frequency) bandwidth of the spatial 
observation. The dimensionality result is obtained by counting 
each collection, with appropriate dimensionality for each. 

The collections are enumerated by the spatial degrees of 
freedom n. Each collection is scaled by the spherical Bessel 
function j' n (fc|r|) from d22l i. These functions have a natural 
high-pass characteristic: for fc|r| < n then j„(^|r|) — > 0. At 
low values of n, 



0<n< eirR{F -W)/c = N 



(32) 



each Bessel function is already active and thus each collection 
has the full eir2A<wT = eir2WT degrees of freedom. For 
higher values of n, 

N = enR{F -W)/c<n< eTrR(F + W)/c = N x (33) 

each collection has a reduced DoF, since the Bessel functions 
are only activated part-way through the frequency band. 
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For each value of n in Figure[3] there are 2n+l independent 
spatial modes. Thus the total degrees of freedom is given by 



V = J2 N TW (n) (2n + 1) < X>i + V 2 



2?i = 



Vn = 
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(2enWT + l)2_^(2n+i) 



(34) 



(35) 



E 

n=N 
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We may solve 
Pi 



(2eirWT+l) \T^L{F -W) 



1 



(37) 



Evaluating (f36t and combining with (l37l > gives the result. ■ 
Proof: [Lemma [3) We are considering bandlimited elec- 
tromagnetic signals, in this case W may be decomposed into 
a band-limiting projection B [11] and a spatial wavefield (or 
Helmholtz) projection G [8]. 

-i rF+W />oo 

Bf(r,t) = — due 1 "* dte-^f(r,t) (38) 

Z7T Jf-W J-oo 
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G/(r,t) = ^/ k exp( i kT) 



(39) 



Write (O as: 



g(r,t) = GBDf(v,t) 



(40) 



We know [11] the operator BD is compact, since it maps 
a unit ball in £2 (finite energy signals) to an essentially 
finite dimensional ball (of approximate dimension 2WT + 1). 
From [4] G is a projection and thus bounded so [17, Lem.8.3-2 
p. 422] the product G ■ BD is compact. ■ 



